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Abstract 



O: 

This paper presents a canonical dual approach for solving nonconvex quadratic 
minimization problem. By using the canonical duality theory, nonconvex primal 
minimization problems over n-dimensional Lorentz cone can be transformed into 
certain canonical dual problems with only one dual variable, which can be solved 
by using standard convex minimization methods. Extremality conditions of these 
solutions are classified by the triality theory. Applications are illustrated. 
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1 Primal Problem and It's Canonical Dual 

The primal problem (V) proposed to solve is the so-called second order cone program- 
ming: 

'kJn! {V): min{p(x) = i(x,Qx)-(x,c> : xgc|, (1) 



where Q G R nxn is a given symmetrical matrix; c G 1" is a given vector; C C 1™ is 
the so-called Lorentz cone in MJ 1 : 

C = {(i 1) x 2 )6lxr 1 | ||x 2 || < Xi, xx > 0}, (2) 

which is a special second order cone. The problem (V) appears in many applica- 
tions such as structural optimization, filter design, and grasping force optimization in 
robotics. Extensive research has been focused on this subject. 

In this paper we present a canonical dual approach for solving the second order 
cone optimization problem (V). By using the canonical duality theory developed in 
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[2j HI [7J |8] , the canonical dual problem (V d ) can be formulated as 

max jp d (a) = ~(c, G-\a)c) : a G 5 a | , (3) 
where G(cr) = Q + crL G , 

/-l 

L Q = 

is the Lorentz matrix, in which, X n _i is an identical matrix in R( n-1 ) x (™ _1 ). The dual 
feasible space S a C R is defined by 

<S a = [ a e R | <r > 0, det G(o) ^ 0}. (4) 



Theorem 1 JTie problem (V d ) is canonically dual to (V) in the sense that the vector 
a G S a is a KKT point of iV d ) if and only if the vector 

x = G- 1 (a)c (5) 

is a KKT point of (V), and 

P(x) = P\a). (6) 

Proof. By the standard procedure of the canonical dual transformation, we rewrite the 
cone constraint ||x 2 || < x\ in the quadratic form |x T L D x < and introduce a nonlinear 
transformation (i.e. the so-called geometrical mapping) e = A(x) = |x T L D x : M. n — > R. 
Thus, the cone constraint x e C can be replaced identically by e(x) = A(x) < 0. Let 

f if e < 0, 

V(e) = " .' (7) 

[ +oo otherwise. 

The primal problem (V) can be written in the following canonical form [7]: 

(V c ) : min |p(x) = V(A(x)) + ^x T g X - c T x | x G M n | . (8) 

According to the Fenchel transformation, the sup-conjugate V" of the function V(e) is 
defined by 

' if a > 0, 
+oo otherwise. 

Since V(e) is a proper closed convex function over R_ := {e G R| e < 0}, we know that 



V\a) =sup{e T a- V{e)} 



a G dV{e) <=> e G dV 9 (a) <=> V{e) + V\a) = to. (9) 
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The pair of (e, a) is then called a generalized canonical dual pair on R_ x M + by the 
definition introduced in [2J H]. Following the original idea of Gao and Strang [TB], we 
replace V(A(x)) in equation (JSJ) by the Fenchel- Young equality V(A(x)) = A(x) T cr — 
V\o~). Then the so-called total complementary function S(x, a) : lR n x M + — > R 
associated with the problem (T c ) can be defined as below 

S(x, a) = A(x) T (T - V\a) + ^x T Qx - c T x. (10) 

By the definition of A(x) and V$(o~), on W 1 x M + we have 

S(x, a) = -k t G(o)k - x T c. (11) 

The criticality condition of S(x, a) leads to the equilibrium equation 

G(a)x = c, (12) 

and the KKT conditions 

a > 0, x T L x < 0, ax T L x = 0. (13) 

Substituting ffl2|) into the canonical dual transformation 

P<V) = sta{E(x,<r) | x G C}, 

the canonical dual function P d (o~) is then formulated. 

It is easy to prove that if a > is a KKT point of {V d ), then we have 

a > 0, VP d (A) = ix(d-) T L x(o-) < 0, (14) 
a ■ (^x(<t) t L x(<t)) = 0, (15) 

where x(a) = G _1 (er)c. This shows that x(<t) is also a KKT point of the primal 
problem (V). 

By the complementarity condition ffTBI) . and the fact of x = G _1 (cr)c, we have 

P\a) = - l -c T G-\a)c 

= ^c T G-\a)c-c T G- l {a)c 

= )^(G-\o)c) T G(o)G- l (o)c - c T G- l (o)c 

= l -{G-\a)c) T {Q + oL )G-\o)c - c T G-\a)c 
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= l -(G-\a)c) T QG-\a)c - c t G-\g)c + ^{G' 1 {a)cf L^ 1 {a)c 

= l -{G-\a)c) T QG-\a)c-c T G-\a)c 

= ^x T Qx - c T x 
= 

This proves the theorem. □ 



2 Extremality Conditions 

Let 

5+ = {a G R | a > 0, G(tr) >- 0}. (16) 
Theorem 2 Suppose that a E S a is a solution to (V) and 

x = G-\a)c. 

If a G <S^~, £/ien x is a global minimizer of P(x) on C anc? 

P(x) = min P(x) = max P d (o-) = PV)- (17) 

Proof. By Theorem [I] we know that the vector a G 5 a is a KKT point of the 
problem (P d ) if and only if x = G~ 1 (cr)c is a KKT point of the problem (V), and 

P(x) = ~(x,a) = P d (a)- (18) 

Particularly, if a G <S+, the canonical dual function P d (a) is concave. In this case, the 
total complementary function H is a saddle function, i.e., it is convex in x G M™ and 
concave in a G iS^ 1 ". Thus, we have 

P d (a) = max P d (a) 



max min H(x, a) = min max H(x, a) 
min < -x T Qx — x T c + max 



2 ^ *es+{\2 



-x T L x ] a - V\a) 1 1 = minP(x) 
2 / J J xgc 



due to the fact that 



V(A(x)) = max | Qx T L x^ a - 1/ tt (a)| 



1 t , \ . ^ , , 1 I if x G C, 

oo otherwise. 



From Theorem [T] we have (ITT)) . □ 
In a special case when Q = Diag (q) is a diagonal matrix with q = {qi} e M n being 
its diagonal elements, we have 



G-\o) = { j> , (19) 



qi + oti. 



In this case, 



n 



P V) = "^E^F' ( 2 °) 

r=i 1 

where 

r — 1 2 = 1 , r 1 z = 1 , s 

5r = { i -^i ' # = { n ^1 • (21) 

1 J ^ 1 ^ \J I ^ 1 

For the given {q}, and {qi} such that — q n < g n _i < . . . ,< qi, the dual variable a 

can be solved completely within each interval — g^ +1 < a < — or — q 2 < a < qi, such 
that qi < q i+ i (i = 2, ■• - ,n). 



3 Applications 

We now list a few examples to illustrate the applications of the theory presented in 
this paper. 

3.1 Two-D nonconvex minimization 

First of all, let us consider two dimensional concave minimization problem: 

(V) : min |p(x) = ^[qix\ + q 2 x\) - C\X\ - c 2 x 2 : ||x 2 || < x u (x u x 2 ) G R 2 | , 

(22) 

On the dual feasible set 

S a = {a eR\a>0, (qi-a)(q 2 + a)^0}, (23) 
the canonical dual function has the form of 



P d (a) = - 1 -[c 1 ,c 2 f r 1 



91— a 

1 



Cl 
C 2 



(24) 



Assume q\ = 0.1, g 2 = —0.3, c\ = 0.5, c 2 = —0.3, so we have 



a = 0.45 6 5+ = {a G R| 0.3 < a < 0.5}. (25) 

By Theorem [fl we know that x = {ci/(gi — cr),c 2 /(g 2 + cr)}= {2,-2} is a global 
minimizer, it is easy to verify that P(x) = P d (a) = — 0.4(see Figure [Tjr2]) . 
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Figure 1: Graphs of P(x) and its contour for two dimensional problem. 
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Figure 2: Graph of P d (a) for two dimensional problem. 
3.2 Two-D general nonconvex minimization 



(V) : min < P(x) = -{q\x\ + q 2 x\ + 2q z xiX 2 ) — c\X\ — c 2 x 2 : ||x 2 || < x%, (x±, x 2 ) G 



On the dual feasible set 

S a = {a G R 2 | a > 0, (g a - a){q 2 + a) - g 3 2 ^ 0}, 
the canonical dual function has the form of 



a 3 ?2 + o"J Lc 2 . 



Cl 



(26) 
(27) 

(28) 



If we choose q% = 1.8, g 2 = —0.6, g 3 = 0.4, c\ = 0.5, c 2 = 0.6, then we have 

a = 1.29 G <S+ = {a G E| (g x - a){q 2 - a) - a\ > 0}. (29) 



By Theorem [TJ we know that x 



q\-o q 3 

<?3 q2 + o 



-1 r 



Cl 
C 2 



{0.5500,0.5499} is a 



global minimizer, and P(x) = P (er) = — 0.3025(see Figure EH]) • 



Figure 3: Graphs of P(x) and its contour for general two dimensional probli 
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Figure 4: Graph of P d (a) for general two dimensional problem. 
3.3 Three-D general nonconvex minimization 



iV): mm^P(x) = ^(x,Qx)-(x,c) : ||x 2 || < x u (x h x 2 ) G R 3 



where Q 



9u 


<?12 


913 


gi2 




923 


913 


923 


933 






s a 



c = {ci, C2, C3}. On the dual feasible set 



where 

9n - o" 9i2 9i3 

G{a) = q 12 q 22 + cr g 2 3 

913 923 933 + O 

the canonical dual function has the form of 



P d (a) = -^[c 1 ,c 2 ,c 3 ] T G-\a) 



Cl 

c 2 
c 3 



Suppose q n = 2, q 22 = -2, g 33 = 1, q 12 = -1, <?i 3 = 2, q 23 = 0, c x = 1.5, c 2 = -0.5, 
c 3 = 1.5, we have 



a = 0.4509 G <S+ = {a G K| tr > 0, G(a) y 0}. 



(34) 



By theorem [U we know that x = G 1 (cr) 



c 2 
c 3 



{0.4355, 0.0416, 0.4335} is a global 



minimizer, and P(x) = P d (a) = — 0.6413(see Figure |5]). 
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Figure 5: Graph of P d (cr) for general three dimensional problem. 



4 Conclusions 



We have presented a concrete application of the canonical dual transformation and 
triality to conic optimization problems. Results show that by the use of this method, 
the nonconvex cone constrained problem (V) in IR ra can be reformulated as a perfect 
dual problem in K., also the KKT points and extremality conditions of the originally 
difficult problems are idetified by Theorem [TJ and |5J Physically speaking, each optimal 
point represents a stable equilibrium state of the system. Duality theory reveals the 
intrinsic pattern of duality relations of these critical points, and plays an important role 
in nonconvex analysis, detailed study and comprehensive applications of this theory 
were presented in monograph [2]. 
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